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ABSTRACT 

In this paper a rather general theory of oblique 
factor rotation is outlined. The main results are formulated as four 
theorems. Necessary and sufficient conditions are derived for two 
factor matrices to admit identical factor structures and/or factor 
patterns with factors having unit variances. These conditions are 
expressed in terms of eigenvectors and eigenvalues of certain 
matrices obtainable from the data. It is also shown that two matrices 
admitting identical factor structures will admit identical factor 
patterns and vice versa. After introducing the notion of a pair of 
transformations to identical structures and/or identical patterns, 
rules are given as to finding such pairs if they exist. Finally, some 
immediate consequences of the theorems are noted. They concern, for 
example, the suitable choice of a target structure and/or pattern and 
a hierarchical order of Jointly necessary and sufficient conditions 
for fitting a specified target perfectly, (Author) 
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SOME GENERAL RESULTS ON FIT IN FACTOR ROTATION 



Walter Kristof 
Abstract 

In this paper a rather general theory of oblique factor rotation is 
outlined. The main results are formulated as four theorems. Necessary 
and sufficient conditions are derived for two factor matrices to admit 
identical factor structures and/or factor patterns with factors having unit 
variances. These conditions are expressed in terms of eigenvectors and 
eigenvalues of certain matrices obtainable from the -data. It is also shown 
that two matrices admitting identical factor structures will admit identical 
factor patterns and vice versa. After introducing the notion of a pair of 
transformations to identical structures and/or identical patterns , rules are 
given as to finding such pairs if they exist. Finally , some immediate con- 
sequences of the theorems are noted. They concern,, for example, the suitable 
choice of a target structure and/or pattern and a hierarchical order of 
jointly necessary and sufficient conditions for fitting a specified target 
perfectly. 
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SOME GENERAL RESULTS ON FIT IN FACTOR ROTATION 1 



1. Introduction 




Transformation of factor matrices is often an indispensable step in 
the course of a factor analytic study. Especially when the study is of the 
confirmatory type, we may wish to rotate an initial factor matrix to a 
specified target. Closeness of fit will be a measure of the success of 
the transformation. 

At times, fit may turn out to be quite unsatisfactory. In such cases 
we may wish to know the conditions responsible, and we may also wish to know 
if fit can be improved by a possibly minor change of the target which the 
investigator might be willing to concede. Necessary and sufficient conditions 
for perfect fit will be derived, and imperfect fit of any degree must then be 
attributable to violations of such conditions . 

Techniques for obtaining optimal fit have been worked out for three 
different problems when rotation of a factor matrix (uncorrelated factors 
of unit variances) to a specified target is required. The problems differ 
with respect to the class of transformations admitted. Least squares 
solutions of the problem of finding an optimal orthogonal transformation 
matrix were given by several writers (e.g., Cliff, 1966: Fischer & Roppert, 
1964; Green, 1952; Kristof, 1964; Schonemann, 1966) . When correlated 
factors are involved, however, then a distinction must be made between 
factor structures and factor patterns. Mosier (1939) was the first to 
derive an approximate least squares method for transforming a given factor 
matrix toward a given target factor structure or, more specifically, the 
reference factor structure usually referred to as the matrix V . Browne 

^Research reported in this paper has been supported by grant GB-18230 
from National Science Foundation. 
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(1967) developed a least squares procedure which is, at least in theory, 
exact. He illustrated it by way of a worked example. Least squares solutions 
for the case in which the specified target is a factor pattern are of a still 
more recent date. Browne and Kristof (1969) worked out a solution and applied 
the method to a set of data. Gruvaeus (in press) dealt with the same basic 
problem and arrived at a different procedure by minimizing a different 
criterion. 

It may be worth noting that the orthogonal "Procrustes ” problem is 
basically different from the more general oblique case. The usual least 
squares goodness of fit criterion as employed first by Green (1952) and 
then by others in the orthogonal situation is invariant under orthogonal 
transformations of the target. Analogous invariance properties of the 
corresponding least squares criterion do not hca.d, however, when the target 
is either a factor structure or a factor pattern, and replacement of the 
original target by another one obtained from the same correlation matrix is 
allowed. On account of this fact, the theory developed in the following 
sections of this paper will be concerned with problems in fitting factor 
structures and factor patterns to target structures and patterns respectively. 

Target matrices will not necessarily be regarded as unalterable. In 
fact, a good deal of the following theory will be applicable to the problem 
of selecting a target. We will give necessary and sufficient conditions 
for two correlation or covariance matrices to admit identical factor structures 
or factor patterns and we will show how to recover such structures or patterns 
if they exist. 

In defining least squares goodness of fit criteria, Browne (1967), 

Browne and Kristof (1969) and Gruvaeus (in press) used a rigidly specified 
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target without assumed knowledge of the correlation or covariance matrix 
from which the target was obtained. We do assume such knowledge, however, 
as will be the case when the target is determined by some earlier study. 

A factor structure or a factor pattern alone does not fully represent the 
information contained in a correlation or covariance matrix. 

For the sake of clarity, the basic matrix notions used in this paper 
will be explained in some detail. Let Z be a (reduced) correlation or 
covariance matrix of order n x n and rank p , p < n . Z is called 
’reduced” when the diagonal elements have been adjusted such as to be 
determined only by common factors in the sense of the traditional linear 
factor analysis model. Consider a decomposition Z = A$A f with A T and 
4>_ having orders n x p and p x p , respectively, and rank p . Matrix 
£ is symmetric and positive definite because Z is symmetric and should 
be left positive semi definite, notwithstanding any adjustment of the 
diagonals. It is further postulated that diag £ = I . Under these 
provisions, A is called a factor pattern. Its elements are regression 
coefficients of tests on factors. Matrix B = Ab is called a factor 
structure . Its elements are covariances between tests and factors. Evidently, 
Z = B0 V . Matrix gives the correlations between factors . If ^ = I , 
i.e., when the factors are taken to be uncorrelated, then factor pattern and 
factor structure coincide. One speaks simply of a factor matrix . It will 
be observed that Z = BA 1 for £ given. 

The entirety of factor structures determined by Z can be written as 
follows. Let F be a factor matrix, Z = FF 1 . Then B = FU with 
diag U'U = I , U full rank, comprises all possible factor structures. 

This formulation is generally valid because any two factor matrices F^ 
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and Fg with F^F^ = F^F^ are related by means of = F^S , S_ orthogonal. 

One observes that U-*'U* = U’U when U* = SU . 

The entirety of factor patterns is given by A = FV with diag(V'V) ^ = I , 

V full rank of course. Again, this formulation is generally valid. In each 

l/2 

case, F may be taken as PT"' when £ = PIT 1 is a canonical decomposition, 

P having orthonormal column vectors and P being a positive definite 
diagonal matrix. 

In writing Z for a correlation or covariance matrix we do not wish to 
imply that Z must be a population matrix. In a typical situation, Z will 
be obtained from a sample. 

The present paper is primarily theoretical in nature. Applications of 
the theory will be contained in another report. 

2 . A Lemma 



A proof of the following lemma will shorten the development of the in- 
tended theory of factor rotation. 

Lemma : Consider the two simultaneous equations 



(1) 



2 

LL £ + 






+ M- | =0 

P P 



•p- 1 • 



p > 2 , the coefficients . being real and not all of them zero. These 

equations admit p linearly independent real "solution vectors J_' = ) 

x p 

if and only if there is a coefficient p. >0 as well - as a coefficient p c 0 . 

D k 

Proof: Necessity of the condition is clear. Sufficiency is inferred 

from considering the following exhaustive distinction of possibilities. 
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(i) Precisely two coefficients are different from zero, > 0 and 
^2 < ^ 9 say * Two linearl y independent solution vectors of the form 
(&!> J can Tound easily. Additional p - 2 linearly inde- 
pendent solution vectors can be chosen to be of the form (0 ,0, . . . , £ ) . 

Thus a set of p linearly independent solution vectors exists. This result 
holds for any p > 2 . 

(ii) Suppose there are exactly K coefficients different from zero, 

2 < K < p . They may be taken as . . . ,1^ with and having 

the same sign. Vie proceed by induction with respect to K , the first 

induction step being contained in (i) . In the sequence both 

signs must occur. By induction assumption, there are p - 1 linearly 

independent solution vectors of the form (0 , § , g . . . , g ) . Analogously, 

^ P 

the sequence will contain coefficients of each sign, hence 

there are also p - 1 linearly independent solution vectors of the form 
(5l^0,§ . . . ,§p) . Among these, there must be at least one solution vector 
with 0 . Adding such a solution vector to the first set gives a total 

of p linearly independent solution vectors. This completes the proof. 

3 . Theorems on Fit 

In this section, some theorems on problems of fit as regards factor 
structures and factor patterns obtained from matrices Z and Z^ will be 
given. The theorems may serve to identify such characteristics of Z^ and 
Z^ which preclude satisfactory fit. The question of goodness of fit in 
relation to the choice of a target will also be considered. The number of 
factors in two matrices under comparison will be assumed equal. 
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Theorem 1 : Let 2^ and =j= , have canonical decompositions 

L = P_T P f and L = PoU^P^ . The following conditions for 2_ and 2_ 
to admit identical factor structures, B = ^ are jointly necessary and 

sufficient : 

1- There is an orthogonal matrix T with P^ = P^T . 

2. W = rj/ 2 T * T^TT^f 2 has an eigenvalue greater than unity as well 
as an eigenvalue smaller than unity. 

Proof: (i) Necessity will be proved first. We write 

-1 = ' diag = I 

( 2 ) 

Bg = > diag U^Ug = I . 

B^ = B q implies that the column vectors of both P^ and are orthonormal 

bases of the same p -dimensional space. Hence there is an orthogonal matrix 
T relating the two bases, P^ = P^T . 

Now, starting with (2), it follows from B^ = and P^P^ = I that 

(3) U-l - • 

Then, using (3) and introducing 
(k) w = ^T'r- 1 ^/ 2 , 

the conditions on the diagonals as stated in ( 2 ) become 

(5) diag £^WU 2 = I , diag « I 

An equivalent formulation is 

(6) diag U £(£ - l)Ug = 0 , diag U^Ug = I . 
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Let W have a canonical decomposition W = C'AC with elements A_^ in the 
diagonal of A . Further, put U* = CU^ and define a diagonal matrix 
M = A - 1^ with elements tv in the diagonal. We will have M 4 0 because 
A = 1 implies W = I and therefore Z^ = Z^ as it follows rather easily 
from (4). Conditions (6) become 

(7) diag U*'MU* = 0 , diag U* f U* = I . 
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Let ) be a row vector of U* T , Conditions (7) can be expressed 

in form (l) where the two simultaneous equations are to admit p linearly 

independent solution vectors. According to the previous lemma this will be 

the case precisely when there is a coefficient |i . > 0 as well as a 

D 

coefficient ja < 0 or, equivalently, when there is an eigenvalue A. > 1 
h ,] 

■ as well as an eigenvalue A^_ < 1 . This completes the necessity part of the 
proof . 

(ii) As to sufficiency, suppose that the conditions given in the theorem 
are satisfied. Thus M = A - I , M and A as defined before ; has positive 
as well as negative elements in the diagonal. It follows from the previous 
lemma that there is a nonsingular matrix U* obeying (7)- Reversing the 
corresponding steps in (i) we arrive at a nonsingular matrix satisfying 

(5) . Wow define a matrix U by means of (3)- Evidently, diag UjU - 
diag U^WU^ = I . Choosing the possible factor structures B = F 

— dr - — <— "”1 — 1 1 — 1 



and B^ = P n T 



pL/a 



TL. one has indeed B-, = EL 



This concludes the proof. 



- 2 . ~ - 1—2 -2 Aiacs "i “ ^2 ’ 

The problem of existence of identical factor structures, and B^ , 

is certainly a symmetrical one. Yet in the formulation and proof of 
Theorem 1 the matrices Z^ and Z^ have been treated unsymmetrically . It 
may therefore be desirable to demonstrate that interchanging the roles of 
E-j and does not affect the theorem materially. 
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Such interchange would evidently not alter condition 1. But W would 



values of W are reciprocals of those of W* which implies that condition 
2 remains materially the same. 

It will be noted that condition 1 in Theorem 1 is equivalent to 

P P* = P P* . 

- 1-1 

An analogous theorem involving factor patterns could be established 
by essentially following the scheme of the proof of Theorem 1. However, a 
somewhat more general statement will be shown to be true. 

Theorem 2 : E^ and E p , ^ > admit identical factor patterns 

if and only if they admit identical factor structures. 

In other words, conditions 1 and 2 in Theorem 1 are jointly necessary 
and sufficient for the existence of both identical factor structures and 
identical factor patterns . 

Proof: Let E^ and E^ have canonical decompositions E^ = P-^r^P^ 

and = P^T^P,!, ' analo Sy to the first paragraph of part (i) in the 

proof of Theorem 1 it is at once inferred that the existence of an orthogonal 
matrix T with P^ = P^T is also necessary for £^ and E^ to admit 
identical factor patterns. Now suppose that E^ and E^ admit Identical 
factor structures, thus conditions 1 and 2 in Theorem 1 are satisfied. 
Introduce matrices 



have to be replaced by 




, T'l^ , However, placing 

and W* = (G/G) 1 . Hence the eigen- 




( 8 ) 





and form 
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It is seen that W = W" 1 , hence the eigenvalues of W are reciprocals of 
those of W . Therefore, according to Theorem 1, and will also 

admit identical factor structures. In other words; there are nonsingular 



matrices and with 



( 10 ) 



p r 1 / 2 !) = P T r"^/ 2 U 

- 1-1 -1 - 1 - 1-2 -2 



diag U^U-^ = diag - I. 



But this is equivalent to 

diag (u“ 1 Up 1 )" 1 = diag (U^U^" 1 )" 1 = I • 



Upon setting 



(11) v ± = up 1 , V 2 = u -- 1 



we obtain instead 



( 12 ) 



Ei^i - Ei 



diag (V^)" 1 = diag (V^Vg) 1 = I 



Therefore Z and Z £ admit identical factor patterns also, as given in (l2) . 
The proof is completed upon noting that each step in this derivation is 
reversible . 

Theorems 1 and 2 have been formulated as existence theorems . The problem 
of actually determining identical factor structures and/or factor patterns, if 
they exist in a given instance, will be our next concern. 
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L e t Z^ = P and Z^ = canonical decompositions. We 

wish to characterize all pairs of transformation matrices U 

diag U^U 2 = I which yield = P-^' 2 U 1 = P^T?/ 2 ^ = Bg . A pair of 
transformation matrices satisfying these conditions v;ill he called a pair 
of transformations to identical structures . Similarly; we wish to charac- 
terize all pairs of transformation matrices with diag(V^V^) = 

dia s (XgZg) 1 = i Which yield ^ = P^T^' 2 ^ = Ag . A pair of 

transformation matrices satisfying the latter conditions will he named a pair 
of transformations to identical patterns . The following theorem gives 
necessary and sufficient conditions for and V-^V^ to he a pair of 

trans format ions to identical structures and a pair of transformations to 
identical patterns; respectively. 

Theorem 3 : Let Z^ and Z^ j — l ^ —2 ’ tiave canonical decompositions 

= P^Pj and Z 2 = P^T^P^ * rank matrices U^,Ug or V are 

a pair of transformations to identical structures or a pair of transformations 
to identical patterns; respectively; if and only if the following conditions 
are met : 

1. There is an orthogonal matrix T with P^ = PI . 

2. Let W = 1 r 1 T^ 2 have a canonical decomposition 

W = C 'Ac . Then is to he chosen such that = CU ^ 

A . 

satisfies simultaneously diag U^(A " = ^ and - 

diag UlXL = I * Matrix 11 is to he taken as IL - rVV\ . 

— 2 — 2 JL — JL — X 2 — 2 

3. As regards factor patterns, is to he chosen such that 

= CV^ satisfies simultaneously diag = 0 

and diag(V^V 0 ) 1 = _I . Matrix is to he taken as 

Y = p"V^rppi/^y 
-I -1 —2 “2 * 
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Proof: The theorem follow's from suitably adapting and interpreting 

the combined proofs of Theorems 1 and 2 quite immediately. 

A /\ _ 1 

It should be noted that the determination of matrices or 

satisfying the above conditions 2 or 3> respectively, is a rather simple 
matter. It amounts to finding linearly independent solutions of a system 
of equations of the form (l) . Then the next step would consist in 

A A 

obtaining = C f U 2 or —2 = 2 * a PP^i exility of this procedure 

depends exclusively upon the existence of T and, secondly, the eigen- 
values of W . 

In the preceding developments repeated use has been made of matrix W 
as originally defined in Theorem 1. In fact, knowledge of the eigenvalues 
of W is required if Theorem 3 is to be applied. 

However, being existence theorems, Theorems 1 and 2 permit a combined 
reformulation which does not explicitly involve matrix W and which may be 
more appealing formally. The following result is obtained. 

Theorem 4 : Let 2^ and 2^ > ^ ^ 2^ , have matrices of eigenvectors 

P^ and P^ , respectively. The following conditions for 2^ and 2^ to 
admit identical factor structures and/or factor patterns are jointly 
necessary and sufficient: 

1. P^ and P^ are orthogonal transforms of each other. 

2. " ^2 a sem i^ e ^i n i"k e matrix. 

Proof: Condition 1 is obvious in view of Theorems 1 and 2. As to 

condition 2, Theorem 1 stipulates that W = rj/^T 1 r^Tr^ 2 have an eigen- 
value greater than unity as well as an eigenvalue smaller than unity. This 
is equivalent to W 1 - I having a positive as well as a negative eigenvalue. 
Or, by a generalization of Sylvester's law of inertia. 
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^ / 2 (w _1 - I)r ^/ 2 





is not a semi definite matrix. This concludes the proof. 



4 . Some Immediate Consequences of the Theorems 



I. Theorem 5 gave rules as to the possible choice of pairs of trans- 
formations to identical structures and pairs of transformations to identical 
patterns. The following consequence may deserve particular interest: Not 

every full rank matrix or satisfying diag U^U ^ = I or 



formations to identical structures or identical patterns; respectively. 
Therefore; if unsatisfactory fit is encountered in rotating a factor matrix 
to a target structure or target pattern; improvement of fit may be attempted 
through a possibly but minor change of the target. The original target may 



transformation or which; when rotation of a factor matrix P.^ 

toward the target is sought; is not close enough to being a possible member 
of a pair of transformations to identical structures or patterns. However; 
there may be another transformation; U* or V* say ; which answers this 
requirement more accurately and which will yield a target that is still 
psychologically meaningful or otherwise useful to the researcher. Of course; 
such a substitution is feasible only if the factor matrix is known from which 
the original target was derived. 

II. According to the previous theory; the following three conditions 
are jointly necessary and sufficient for actually attaining perfect fit 
when a target is specified: 



diag^^V^) ^ = I can be taken as a possible member of a pair of trans- 



have been' obtained from rotating a factor matrix p tV 2 by means of a 

— 2 — 2 
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(i) P^ and Pg span identical spaces, i.e.^ there is an 
orthogonal matrix T satisfying Pg = P^T . 

(ii) W = ^ las an eigenvalue greater than unity as 

well as an eigenvalue smaller than unity ( Z^ - Zg is not 
semi definite) . 

(iii) Transformation matrix Ug or Vg is a member of a pair of 

transformations to identical structures or identical patterns. 
These three conditions form a hierarchical order . Condition (ii) becomes 
meaningful only if condition (i) is already met. Condition (iii) can be 
checked upon only if both conditions (i) and (ii) are satisfied. If con- 
ditions (i) and/or (ii) are not fulfilled then perfect fit can under no 
circumstances be achieved, even if any choice of a target were permitted. 

III. Suppose that two covariance (correlation) matrices, Z^ and Zg > 
admit identical factor structures or factor patterns . Then, typically, the 

corresponding correlation (covariance) matrices D n Z 7 D-, and D^Z^Ik , D_ 

— l—l—l — d d — d —1 

and L> diagonal nonscalar matrices, will not allow for identical factor 



structures or factor patterns. For, consider the canonical decompositions 

-1 = - 1 - 1-1 * —2 = 2 > - 1 - 1-1 = and - 2 ^ 2^2 = * Wow 
P g = P^T with T orthogonal does in general not imply Qg = Q^S with IS 



orthogonal . 
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